Papers with U.S. annotators
Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent work has highlighted the culturally-contingent nature of commonsense knowledge . a multi-stage process is used to evaluate the commonsence of English LLMs . |
| Approach: | They propose a test set of 525 multiple-choice questions to evaluate commonsense knowledge of English LLMs in Ghana and the u.s. They use existing commonsensible datasets to rewrite them in a multi-stage process. |
| Outcome: | The proposed model improves on the culturally-contingent commonsense knowledge of English LLMs in Ghana and the United States. |